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Objective. The objective of this study was to deter¬ 
mine the validity of tobacco questionnaires when using 
as gold standard either a single biomarker or a combi¬ 
nation of two biomarker s. 

Methods. The methods were self-reported smoking 
compared with salivary thiocyanate and expired car¬ 
bon monoxide in a 1996, population-based, Swiss sur¬ 
vey of 652 men and 565 women. 

Results. Sensitivity of self-reported smoking relative 
to salivary thiocynate or carbon monoxide alone was 
low (38.2% for salivary thiocyanate a 100 mg/L, 56.4% 
for salivary thiocyanate S: 150 mg/L and 62.6% for car¬ 
bon monoxide a 9 ppm). When defining true positive 
smokers as people with high concentration of both sali¬ 
vary thiocyanate and carbon monoxide, overall, sensi¬ 
tivity was 88.6% and specificity was 87.2%. In women, 
sensitivity increased from 85 to 89% when Removing 
subjects exposed to passive smoking. When excluding 
heavy smokers, sensitivity decreased to 63% in men 
and to 71% in women. Older women bad tendency to 
misreport smoking. 

Conclusions. This comparison of questionnaire data 
with the simultaneous measurement of salivary thiocy¬ 
anate and expired carbon monoxide indicates that 
valid responses can be obtained for self-reported, cur¬ 
rent smoking in population-based surveys. However, 
the validity of questionnaires can be underestimated 
if the gold standard (of exposure to tobacco smoke) is 
either high levels of carbon monoxide or high levels 
of salivary thiocyanate. 0 £000 American Health Foundation and 
Academic Pres* 
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INTRODUCTION 

Self-reported smoking is usually validated against a 
single biomarker of tobacco exposure, such as cotinine 
and salivary thiocyanate (SCN) (in the plasma, the sa¬ 
liva or the urine) or expired carbon monoxide (CO) [1,2]. 
Its sensitivity varies between 6 and 97% when com¬ 
pared with SCN and between 46 and 100% when com¬ 
pared with CO. Its specificity varies between 33 and 
98% with salivary SCN and between $9 and 99% with 
CO [2]. 

A single biomarker may not be sufficient to assess 
exposure to tobacco smoke, because smoking is a discon¬ 
tinuous process [7,3], Expired CO reflects short-term 
exposure to tobacco smoke. When combined with a 
longer half-life biomarker such as serum cotinine or 
serum SCN (CO and cotinine, or CO and SCN), the 
total misclassification rates of smoking status (2.2 to 
8% when using a single biomarker) decreased to 1.1% 
[7]. In the Multiple Risk Factor Intervention Trial, us¬ 
ing both expired CO and serum SCN decreased the 
percentage of misclassification to 9.6% compared to 
11.7% with SCN alone or 12.4% with CO alone [3]. Even 
though these studies validated the markers against 
questionnaire data—rather than questionnaire data 
against the marker—they indicate a potential advan¬ 
tage of combining expired CO with a second biomarker. 

In this Swiss, population-based survey, we assessed 
the validity of questionnaire data on smoking using as 
“gold standard” individual or combined concentrations 
of SCN and expired CO. Compared to cotinine or nico¬ 
tine, CO and SCN were an advantageous choice of bio¬ 
markers for a population-based study because of their 
low financial costs and their methodological simplicity. 
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SUBJECTS AND METHODS 

Subjects 

In 1996, a random sample of the adult population of 
Geneva was selected to represent the 89,000 male and 
98,000 female noninstitutionalized residents of Canton, 
Geneva, ages 35 to 74 years [4]. Subjects were identified 
from an official list of all residents that included names, 
date of birth, address, and nationality. Random sam¬ 
pling in age-sex-nationality strata was proportional 
to the corresponding distributions in the Geneva popu¬ 
lation. Subjects were asked by mail to participate in a 
population health survey. In case of nonresponse after 
15 days, they were called by telephone up to seven times 
on different days of the week and at different hours of 
the day and, if necessary, sent a second and third letter. 
A systematic check in the following yearly edition of 
the list has shown that over 90% of the subjects who 
were not reached did not reside in Geneva anymore. 
Subjects who refused to participate were not replaced. 
The overall recruitment procedure of a subject took up 
to 2 months. Participation rate was 70%; 596 women 
and 579 men participated in the study. 

Subjects were invited to visit a mobile epidemiology 
unit where trained interviewers helped them to com¬ 
plete a detailed questionnaire about sociodemographic 
factors, smoking behavior, health, and dietary habits. 
The smoking history section of the questionnaire was 
structured as a calendar. Smoking exposure was re¬ 
corded year by year, between age 10 and the date of 
interview. An episode of exposure consisted of a time 
period of at least 6 months during which thq person had 
actively smoked. For each episode of active smoking, 
number of cigarettes per day, filter, and cigarette brand 
were recorded. Because this survey was part of a study 
on the influence of environmental tobacco smoke (ETS) 
exposure on women's health [5], three additional calen¬ 
dars dedicated to ETS exposures at home, at work, and 
during leisure were submitted to women but not to men. 
The number of hours per week of ETS exposure episode 
was recorded. In addition, for both men and women, 
there were specific questions on possible acute exposure 
to ETS during the past 24 h before the interview. Parti¬ 
cipants were also asked to report recent consumption 
of cabbage, broccoli or almonds [6]. These foods contain 
cyanogenic glycosides, which are hydrolyzed within the 
oral cavity, or upon digestion, to form labile cyanohy¬ 
drins, which decompose into a carbonyl compound and 
hydrogen cyanide (IICN). HCN is detoxified into SCN, 
which cannot be differentiated in the saliva from to¬ 
bacco SCN. 

Noncurrent smokers comprised both never smokers 
(subjects who had never smoked or smoked less than 
100 cigarettes in their lifetime) and exsmokers (subjects 
who had stopped smoking, for at least 1 year). Current 
smokers were categorized into ’light’ (^10 cigarettes 


per day) or ’heavy 1 (>10 cigarettes per day). This defini¬ 
tion of heavy smoking is not traditional, especially for 
men, but it was chosen because otherwise the number 
of female heavy smokers was too small. For women, a 
current exposure to ETS was defined as an exposure 
of, on average, at least 1 h per day during the whole 
year preceding the interview. 

SCN Measurement 

Saliva was collected using a cotton cylinder masti¬ 
cated for 30 s and stored in an anonymous test tube 
at 5°C. Within 8 days, tubes were transferred to the 
laboratory of the Institute of Occupational Health Sci¬ 
ences in Lausanne, Switzerland. Saliva was centrifuged 
for 2 min at 1,000 g and analyzed using a colorimetric 
method [7]. 

Expired CO Measurement 

During the interview, participants were told to hold 
their breath 15 s and then blow slowly into a Micro 
Smokerlyzer from Bedfont Ltd. (Sittingbourne, UK). 
This portable monitor is equipped with a hydrophobic 
filter that protects the sensor from the condensed water 
vapor and the ethanol groups present in the breath of 
the individuals using the device. The instrument was 
calibrated regularly according to the instructions of 
the manufacturer. 

Data Analysis 

Distributions of biomarker concentrations were pre¬ 
sented using box plots (the box represents the inter¬ 
quartile range and the median; the whiskers are at the 
10th and 90th percentiles). To determine sensitivity 
and specificity of the reported smoking status, cutoffs 
were fixed both at 100 mgL [2,6,8,9] and 150 mg/L 
for salivary SCN, and at 9 ppm for CO [2,6,10,11]. A 
combination of SCN and CO was also evaluated in 
which subjects were categorized as smokers if they bad 
salivary SCN levels £ 150mg/L and expired CO s 9 
ppm, and as noncurrent smokers otherwise. 

Sensitivity and specificity of self-reported smoking 
were determined relative to the biomarker. Sensitivity 
was calculated as the number of self-reported smokers 
with a biomarker level above the cutoff divided by the 
total number of subjects with a biomarker level above 
the cutoff. Specificity was calculated as the number 
of self-reported noncurrent smokers with a biomarker 
level below the cutoff divided by the total number of 
subjects with a biomarker level below the cutoff. Sensi¬ 
tivity and specificity were studied in different sex, age, 
and cigarette consumption subgroups. 

RESULTS 

All participants answered the questionnaire and pro¬ 
vided SCN and CO. Fifty-eight subjects (4.8%), 27 men 
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and 31 women, with high SGN or CO were excluded 
because they gave insufficient saliva, reported high ex¬ 
posure to ETS, or had consumed cabbage, broccoli, or 
almonds in the 24 h before the interview. This analysis 
is therefore based on 552 men and 565 women. 

Mean salivary concentration of SON was 108 mg/L 
(SD 68 mg/L) among noncurrent smokers and 212 mg/ 
L (SD 92 mg/L) among current smokers. Median SCN 
was at 98 and 206 mg/L, respectively. Mean expired 
CO level was 5.5 ppm (SD 4.8 ppm) among noncurrent 
smokers and 19.7 ppm (SD 13.6 ppm) among current 
smokers. Median CO was 4 and 19 ppm, respectively. 

Figures 1 and 2 present salivary SCN and CO distri¬ 
butions by age and sex according to self-reported to¬ 
bacco consumption. In all ages and genders, SCN distri¬ 
butions in smokers were shifted upward compared to 
noncurrent smokers (Fig. 1), but distributions over¬ 
lapped. No major differences appeared according to age 
among men. Among women, SCN levels of smokers 
were lower in the oldest age group. CO distributions 
were also shifted upward among smokers (Fig. 2). There 
were only a few extremely high values among noncur¬ 
rent smokers. Median levels of CO were lower in older 
current smokers. 

Consistently high levels of both CO (2: 9 ppm) and 
salivary SCN (a 150 mg/L) were observed in 184 sub¬ 
jects (16.2%). In contrast, discrepant levels of CO and 
SCN occurred either as (a) high CO/low SCN: 137 sub¬ 
jects (12.0%) had a CO level £ 9 ppm but a level of 
salivary SCN < 150 mg/1; in this group, smokers 
smoked an average of 19 cigarettes/day and 27% of the 
women were exposed to ETS; or as (b) low CO/high 
SCN: 153 subjects (13.5%) had salivary SCN levels £ 
150 mg/I but CO levels < 9 ppm; in this subgroup, 
smokers smoked an average of 9 cigarettes/day and 
prevalence of ETS exposure was 9.5% among women. 

Over the whole sample, the sensitivity was 62.6% 
with CO, 38.2% with SCN £100 mg/1, and 56.4% with 
SCN £ at 150 mg/L. Specificity was 89, 89 and 88%, 
respectively. When combining CO £ 9 ppm and SCN 
> 150mg/L, sensitivity was 88.6% and specificity was 
.87.2%. Table 1 presents the validity by gender and age 
of reported smoking. For each ages, the sensitivity was 
higher in males than in females except with the combi¬ 
nation SCN and CO among subjects 35-54 (91.6% in 
men and 92.8% in women). Sensitivity decreased with 
age, especially in women. With SCN £ 100 mg/1, the 
sensitivity was low in all ages and gender, and very low 
in women aged 55-74 years (14.7%). Specificity of the 
combined CO £ 9 ppm and SCN £ 150 mg/1 varied 
between 83% (men, 35-54 years) and 93.1% (women, 
55-74 years). 

Table 1 also shows the validation o’freported smoking 
relative to SCN and CO by age in woinen, after exclu¬ 
sion of female noncurrent smokers who were currently 



m 



exposed to ETS. Data on ETS exposure were not avail¬ 
able for men. Sensitivity increased (for example, women 
ages 35-54 years, from 92.8 to 98.1%), while specificity 
slightly decreased. 

Table 2 presents the validity of reported smoking 
relative to SCN and CO by gender and age and by daily 
consumption of cigarette. In men ages 35—54 years, 
sensitivity was 68.2% in light smokers versus noncur¬ 
rent smokers and 91% in heavy smokers versus noncur¬ 
rent smokers. Similar contrasts were observed for older 
men. In young women, sensitivity was similar in light 
and heavy smokers (about 90%), but in older women, 
sensitivity was lower in heavy smokers than in light 
smokers. In. both genders, sensitivity decreased with 
age, but specificity slightly increased. 

The analyses in Table 2 were also performed for each 
individual biomarker. Sensitivity obtained with SCN £ 
100 mg/L was very low, ranging from 6.9% (women, 
55—74 years, heavy smokers vs noncurrent smokers) 
up to only 45.3% (men 35-54 years, heavy smokers vs 
noncurrent smokers). 

DISCUSSION 

Sensitivity of self-reported smoking relative to SCN 
>100 mg/L was low. A sensitivity of 56.4% was obtained 
using SCN >150 mg/L. However, when combining both 
biomarkers, the validity of self-reported smoking in¬ 
creased substantially with a sensitivity of 88.6% for the 
whole sample and of 98.1% in young women not exposed 
to ETS. Specificity remained high at 87.2%, indicating 
that the questionnaire detected most people not ex¬ 
posed to tobacco smoke according to the combination of 
SCN (> 150 mg/L) and CO (> 9ppm). 

SCN and CO in exhaled air proved to be a convenient 
choice in a population-based survey with a sample size 
of 1,117 subjects because they are noninvasive, simple, 
and inexpensive methods. In addition, we were able 
to prevent a possible contamination of SCN levels by 
dietary cyanogenic glycosides by excluding the subjects 
who had eaten such foods before undergoing the test. 

The striking improvement in validity of smoking 
questionnaires when using a combination of SCN and 
CO rather than a single biomarker can be explained by 
the fact that biomarkers reflect different components 
of the exposure to tobacco smoke. 

Half-life varies between 3 and 8 h for CO [12] and 
between 5 and 15 days for SCN [13], Thus, an irregular 
consumption of cigarettes may induce a constant, high 
level of thiocyanate but a relatively low level of CO 
between episodes of smoking. Alternatively, CO can be 
high and SCN low if a usually light smoker smoked a 
cigarette shortly before the interview. Indeed, observa¬ 
tions in subjects with nonconcordant levels of CO and 
SCN supported this hypothesis. Subjects with low CO 
but high SCN smoked in average 9 cigarettes/day 
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FIG. 1. Distributions (box plots) of SGN levels (SCN)by age and by current smoking status, in males and females. The boxes represent 
the interquartile range and the median near the middle; the whiskers represent the range between the 10th and the 90th percentiles. 
Geneva, Switzerland, 1996. ' " 
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PIG. 2. Distributions (box plots) of expired CO concentration (CO) by age and by current smoking status, in males and females. The 
boxes represent the interquartile range with the median near the middle; the whiskers represent the range between the 10th and the 
90th percentiles. Geneva, Switzerland, 1996. 
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TABLE 1 

Validity of Self-Reported Current Smoking Status According to Biomarkers, by Age and Gender. Geneva, Switzerland, 1996 


Men Women 


Biomarker (cut-off) 

Validity 

All 35 to 

74 years 
(re = 1117) 

35 to 54 
years 
(n = 347) 

55 to 74 
years 
(n = 205) 

35 to 54 
years 
(n = 372) 

55 to 74 
years 
(n = 193) 

CO (&9ppm) 

Sensitivity 

62.6 

73.1 

56.9 

62.5 

33.3 


Specificity 

89.3 

88.0 

90.3 

88.1 

93.0 

SCN (>100 mg/L) 

Sensitivity 

38.2 

53.4 

36.8 

40.6 

14.7 


Specificity 

88.5 

87.3 

91.8 

86.1 

91.7 

SCN (>150 mg/L) 

Sensitivity 

56.4 

73.0 

47.7 

63.9 

25-0 


Specificity 

87.9 

84.1 

90.7 

87.3 

92.9 

CO (a9ppm) + SCN 

Sensitivity 

88.6 

91.6 

88.9 

92.8 

61.1 

(tel50 mg/L) 

Specificity 

87.2 

83.0 

88.8 

85.8 

93.1 


Sensitivity 


NA 

NA 

98.1 

61.1 


Specificity 0 


NA 

NA 

80.5 

91.6 


Note. CO, expired CO; SCN, salivary thiocyanate; NA, data on passive smoking not available for men, 
° After exclusion of female noncurrent smokers who were currently exposed to ETS. 


whereas those with high CO but low SCN levels smoked 
19 cigarettes/day. 

Tlte present results are in. line with previous studies 
combining CO and SCN [1,3,14], even though designs 
are not fully comparable. It is important to note that a 
restrictive definition of exposure (i.e., high levels of both 
SCN and CO) will have different implications when 
biomarkers are validated against questionnaire data, 
or when questionnaire data are validated against bio¬ 
markers. When validating biomarkers against ques¬ 
tionnaires, a restrictive definition of a smoker based on 
the positivity of two biomarkers will decrease sensitiv¬ 
ity: for example, among self-reported smokers, fewer 
people will test positive for SCN s 100 mg/L than for 
SCN a: 150 mg/L, In contrast, when validating the ques¬ 
tionnaire against the biomarkers, a restrictive defini¬ 
tion of the gold standard will increase sensitivity: for 
example, there will be a larger proportion of self-re- 
ported smokers among subjects testing positive for SCN 


s 150 than for SCN s 100 mg/dL. Indeed, in this study, 
questionnaires had greater sensitivity against SCN ^ 
150 mg/L than against SCN & 100 mg/L. 

Self-reported smoking was systematically less sensi¬ 
tive in women and in older subjects, even after stratifi¬ 
cation by ETS exposure or average daily cigarette con¬ 
sumption. The sensitivity loss was the largest among 
older women. An older population, particularly older 
women, may tend to misreport smoking habits [153. 
Aging subjects may become more conscious of the risks 
due to tobacco when they get older [161 and may prefer 
to misreport their smoking habits during a health sur¬ 
vey. Another explanation could be that because smoking 
was rare before I960 among Swiss women [17], older 
women may be reluctant to reveal their true cigarette 
consumption [IS]. 

The strength of this study is its population-based 
design, with a high participation rate compared to other 
surveys [19]. Because the target population was clearly 


TABLE 2 

Validity of Self-Reported, Current Smoking Status Relative to the Combined Expired Carbon Monoxide (CO 5= 9ppm) and Salivary 
Thiocyanate (SCN a 150 mg/L), by Age, Gender. Geneva, Switzerland, 1996 





Men, ages 

Women, ages 



All, ages 35 

35 to 54 

55 to 74 

35 to 54 

55 to 74 



to 74 years 

years 

years 

years 

years 

Self-reported smoking status 

Validity 

(re = 1117) 

(n = 347) 

,(re = 204) 

(re = 372) 

(re = 193) 

Light current smokers" vs noncurrent smokers 

Sensitivity 

65.5 

68.2 

40.0 

89.5 

41.7 


Specificity 

90.3 

90.9 

94.1 

86.7 

92.6 

Heavy current smokers 6 vs noncurrent smokers 

Sensitivity 

77.S 

a 1.0 

88.0 

89.7 

21.4 


Specificity 

94.3 

90.5 

93.5 

95.6 

100.0 


G Light current smokers: s 10 cigarettes/day. These represent 11.0% of younger men, 5,4% of older men, 29.0% of younger women, 20.2% 
of older men. 

4 Heavy current smokers: > 10'cigarettes/day. These represent 24.2% of younger men, 1,5,7% of older men, 24,2% of younger women, 9,3% 
of older women. 
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defined and enumerated, we were able to confirm the 
representativeness of the sample relative to the age, 
gender, and nationality distribution in the population. 
We also.were able to rule out a possible selection related 
to crude smoking categories by obtaining the smoking 
status of subjects who refused to participate [20]. Fi¬ 
nally, only 5% of the sample had to be excluded from 
some analysis because these people had given insuffi¬ 
cient saliva or had been recently exposed to ETS or to 
foods containing cyanogenic glycosides. 

Even though the validity of the questionnaire relative 
to both biomarkers was high (e.g., a sensitivity and 
specificity of about 90% in the whole sample), it was 
not perfect. This implies that some misclassification of 
smoking status still occurs and needs to be taken into 
consideration when planning the sample size of an asso¬ 
ciation study involving questionnaire data on smoking 
or when interpreting the results. For example, if it can 
be assumed that the questionnaire has a similar accu¬ 
racy among cases and controls, then the imperfect valid- ■ 
ity will tend to bias the results of such studies toward 
the null 1 21], Whether this bias will be substantial or 
not will depend on the context. 

CONCLUSION 

Self-reported, current smoking was found to be poorly 
sensitive when only SCN or CO was used as biomarker 
of exposure to tobacco smoke, but highly sensitive when 
the combination of both biomarkers was used. The two 
biomarkers may measure different aspects of exposure 
to ETS. Combination of CO and SCN shows that''current 
smoking can be validly self-reported in population- 
based surveys. 
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